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Abstract — An unknown vector / in R" can be recovered from 
corrupted measurements y — Af + e where A mxn (m > n) 
is the coding matrix if the unknown error vector e is sparse. 
We investigate the relationship of the fraction of errors and the 
recovering ability of /,, -minimization (0 < p < 1) which returns 
a vector x minimizing the "Z p -norm" of y — Ax. We give sharp 
thresholds of the fraction of errors that determine the successful 
recovery of /. If e is an arbitrary unknown vector, the threshold 
strictly decreases from 0.5 to 0.239 as p increases from to 1. If e 
has fixed support and fixed signs on the support, the threshold is 
| for all p in (0, 1), while the threshold is 1 for l\ -minimization. 



I. Introduction 

We consider recovering a vector / in R" from corrupted 
measurements y = Af+e, where A mxn (m > n) is the coding 
matrix and e is an arbitrary and unknown vector of errors. 
Obviously, if the fraction of the corrupted entries is too large, 
there is no hope of recovering / from Af + e. However, if the 
fraction of corrupted measurements is small enough, one can 
actually recover / from y = Af + e. As the sparsity of e is 
represented by the Iq norm, ||e||o := \{i ■ e.% =^ 0}|, one natural 
way is to find a vector x such that the number of terms where 
y and Ax differ is minimized. Mathematically, we solve the 
following Iq -minimization problem: 



mm 



\y - Ax\\ . 



(1) 



However, (fl]i is combinatorial and computationally intractable, 
and one commonly used approach is to solve a closely related 
li -minimization problem: 



mm 



\y - Ax\\ 



(2) 



where ||x||i := J2i \ x i\- © can ^ e recas t as a linear program, 
thus can be solved efficiently. Conditions under which (|2]i can 
successfully recover / have been extensively studied in the 
literature of compressed sensing (fl~)-||6]). For example, El 
gives a sufficient condition known as the Restricted Isometry 
Property (RIP). 

Recently, there has been great research interest in recovering 
/ by ^-minimization for p < 1 (llTl- lOTl ) as follows, 



min \\y- Ax\\ p . 



(3) 



Recall that ||x||P := (£ 4 \xi\ p ) for p > 0. We say / can be 
recovered by ^-minimization if and only if it is the unique 
solution to (f3]). Then the question is what is the relationship 
between the sparsity of the error vector and the successful 
recovery with ^-minimization? (01 is non-convex, and thus it 
is generally hard to compute the global minimum. However, 



shows numerically that we can recover / by finding a 
local minimum of (fJJ, and ^-minimization outperforms l\- 
minimization in terms of the sparsity restriction for e. @ 
extends RIP to Z p -minimization and analyzes the ability of 
Zp-minimization to recover signals from noisy measurements. 
ifTTI also provides a condition for the success recovery via 
Zp-minimization, which can be generalized to Li case. Both 
conditions are sufficient but not necessary, and thus are too 
restrictive in general. 

Let e € R m be an arbitrary and unknown vector of errors 
on support T — {i : e, ^ 0}. We say e is pm-sparse if 
\T\ < pm for some p < 1 where \T\ is the cardinality of 
set T. Our main contribution is a sharp threshold p*(p) for 
all p < 1 such that for p < p*(p), if m > Cn for some 
constant C and the entries of A are i.i.d. Gaussian, then l p - 
minimization can recover / with overwhelming probability. 
We provide two thresholds: one (p*) is for the case when e 
is an arbitrary unknown vector, and the other (p^) assumes 
that e has fixed support and fixed signs. In the latter case, the 
condition of successful recovery with l\ -minimization from 
any possible error vector is the same, while the condition 
of successful recovery with Zp-minimization (p < 1) from 
different error vectors differs. Using worst-case performance 
as criterion, we prove that though l p outperforms li in the 
former case, it is not comparable to li in the latter case. Both 
bounds p* and p'^, are tight in the sense that once the fraction 
of errors exceeds p* (or p^), Zp-minimization can be made to 
fail with overwhelming probability. Our technique stems from 
fTZl . which only focuses on li -minimization and the case that 
e is arbitrary. 

II. Recovery From Arbitrary Error vector 

In this section, we shall give a function p*(p) such that 
for a given p, for any p < p*(p), when the entries of A 
are i.i.d. Gaussian, the /p-minimization can recover / with 
overwhelming probability as long as the error e is pm-sparse. 

The following theorem gives an equivalent condition for the 
success of l p minimization ( JTJ, |[8l). 

Theorem 1 ( [71, [8|). / is the unique solution to l p min- 
imization problem (0 < p < 1) for every f and for every 
pm-sparse e if and only if 



Y,\{Az)i\ P < £ \iAz)i 



(4) 



for every z € R™, and every support T with \T\ < pm. 

One important property is that if the condition © is satisfied 
for some < p < 1, then it is also satisfied for all < q < p 



(1 10]). Now we define the threshold of successful recovery p* 
as a function of p. 

Lemma 1. Let X\, X2,...,X m be i.i.d N(0, 1) random vari- 
ables and let Y\, Y<i,... ,Y m be the sorted ordering (in non- 
increasing order) of \X\\ P , \X2\ P ,~., \X m \ p for some p G (0,1]. 

[pm] 

For a p > 0, define S p as ^ Yi. Let S denote E[Si], the 

i=l 

expected value of Si. Then there exists a constant p*(p) such 
that lim = i. 

Proof: Let X - N(0, 1) and let Z = Let /(*) 
denote the p.d.f. of Z and F(z) be its c.d.f. Define g(t) = 
J t z p f(z)dz. g is continuous and decreasing in [0,oo], and 
3(0) = E[Z P ] = rim t _ ! . 00 g(t) = 0. Then there exists z* 
such that g(z*) = ^p-, we claim that p* = 1 - F(z*) has the 
desired property. 

Let T t = Eiry^tP**- Then P[T Z .] = m. 9 (z*). Since 
£[|T Z . - SL. |] is bounded by 0(-y/m), and 5 = m 5 (0), thus 
lim Sgg] - I 



Proposition 1. The function p*(p) is strictly decreasing in p 
on (0,1]. 

Proof: From the definition of 2* and p*(p), we have 

/>z* />oo 

H(z*,p):=J x p f{x)dx-J x p f(x)dx = 0, (5) 



and 



p* = l-F(z*), 



where /(•) and F(-) are the p.d.f. and c.d.f. of \X\, X 
AT(0,1). 

From the Implicit Function Theorem, 



dz* a^- Jo x p (lnx)/(x)dx — J* z » x p (lnx).f (x)dx 
~dp ' ~TgL ~ 2z* p f(z*) 

From the chain rule, we know 4r- — ^tt^j—, thus 

dp az dp 

dp* _ Jq x p (lnx)f(x)dx-J^x p (\nx)f(x)dx 



dp 



2z* p 



(6) 



Note the numerator of (O is less than from thus < 



0. 



We plot p* against p numerically in Fig.Q] p*(p) goes to i 
as p tends to zero. Note that p*(l) = 0.239..., which coincides 
with the result in Ifl2l . 

Now we proceed to prove that p* is the threshold of 
successful recovery with l p minimization for p in (0, 1]. First 
we state the concentration property of S p in the following 
lemma. 

Lemma 2. For any p G (0, 1], let X\,...,X m , Y\,...,Y m , S p 
and S be as above. For any p > and any 8 > 0, there exists 
a constant c\ > such that when m is large enough, with 
probability at least 1 - 2e~ Cim , \S P - E[S P } \ < SS. 




Fig. 1. Threshold p* of successful recovery with l v -minimization 

Proof: Let X = [Xi, X m ] T . If two vectors X and 
X 1 only differ in co-ordinate i, then for any p, \S p (X) — 
S p (X')\ < \\Xi\ p - \Xl\ p \. Thus for any X and X', 



W-|*iT|=£ 



\Xi\ p -\X'\ p \. 



\S P (X)-S P (X')\< J2 

Since \ \Xi\ p - \X[\ P \ < |JQ - X[\ p for all p e (0, 1], 

\S p (X)-S p (X')\<J2\Xi-Xi\ p . (7) 

i 

From the isoperimetric inequality for the Gaussian measure 
(H3), for any set A with measure at least a half, the set 

A t — {x G R m : d(x, A) < t} has measure at least l-e~* 2/2 , 
where d(x, A) — inf y6j 4 \\x— y\\2- Let M p be the median value 
of S p = S p {X). Define set A = {x G R m : S p (x) < M p }, 
then 



Pr[d(x, A) < t] > 1 



-t 2 /2 



We claim that d(x,A) < t implies that S p (x) < M p + 
m (i- P /2) t p_ if x e A, then S p (x) < M p , thus the claim 
holds as m 1 ~ p / 2 t p is non-negative. If x £ A, then there exists 
x' G A such that ||x — x'\\2 < t. Let Uj = 1 for all i and let 
Vi = \xi — x^| p . From Holder's inequality 

/ \ 1-P/2 / \ p/2 

E^-^P < (£ki 2/(2 - p) J (£h 2/p J 

< m^-^^f 72 = m^-^V (8) 

From CD and ©, |Sp(x) - Sp(x')| < mP-rMlP. Since 
x ^ A and x' G A, then S p (x) > M p > S p {x'). Thus S p (x) < 
M p + m,( 1 ~ p / 2 H p , which verifies our claim. Then 

Pr[S p {x) < M p +m^- p / 2 h p ] > Pr[d{x,A) <t]> l-e"* 2 / 2 . 

(9) 

Similarly, 



Pr[S p (x) > M p 



,(1-p/2) 



t P ] > 1 



-t 2 /2 



Combining © and (fTOb , 

Pr[|S p (x) - M p \ > m {1 ~ p ' 2 h p ] < 2e~* 2 / 2 . 



(10) 



(11) 



The difference of E[S P ] and M p can be bounded as follows, 

\E[S P ]-M P \ < E[\S P -M P \] 

poo 

= / Pr[\S p (x)-M p \>y]dy 
Jo 

/•OO , 2 (1-2) 

< / 2e-? yPm P dy 



and 







./o 



Note that c := J °° 2e 2 s P <is is a finite constant for all 
p € (0, 1]. As p > and S = m.E[|a;j| p ], thus for any 5 > 0, 



cm 



(l-f) 



< § S when rn is large enough. 



Let t = (±SSm<-i~V) p = (±5E[\xi\ p ])* y/fn, from (QT) 



2" 

I/I; 



with probability at least (l-2e-2(5 5B [b ! n) Pm ), |S p -A/ p | < 
±<5S. Thus |S P - £[S P ]| < \S P - M p \ + \M p - E[S P }\ < 5S 
with probability at least 1 — 2e~ Cim for some constant c\. ■ 

Corollary 1. For any p < p* , there exists a 8 > and a 
constant C2 > such that when m is large enough, with 
probability 1 - 2e' C2m , S p < (§ - S)S. 

Proof: When p < p*, 

[>*m] 

£[S P ] = £[£,.]- E E[\Xi\*] 

i=\ P m]+l 

< E[S P *] — (\p*m~\ — \ prn\)E\\ i X i \ p ] 

Then E[S p ]/S < \ - 26 for a suitable J as 5 = toE^X^]. 
The result follows by combining the above with Lemma [2] ■ 

Corollary 2. For any e > 0, there exists a constant C3 > 
such that when to is large enough, with probability 1 — 2e~ C3 "\ 
it holds that (1 - e)S < Si < (1 + e)S. 

The above two corollaries indicate that with overwhelming 
probability the sum of the largest \pm\ terms of !7s is less 
than half of the total sum Si if p < p*. The following lemma 
extends the result to every vector Az where matrix A mxn has 
i.i.d. Gaussian entries and z is any vector in R". 

Lemma 3. For any < p < 1, given any p < p*(p), there 
exist constants C4, C5, 5 > such that when to > C4TL and n 
is large enough, with probability 1 — e _C5n , an to x n matrix 
A with i.i.d. N(0, 1) entries has the following property: for 
every z € R™ and every subset T C {1, to} w;/n |T| < pm, 

E l(^l p -EI(^)*l p ><5S||^. 

ieT<= ieT 

Proof: For any given 7 > 0, there exists a 7-net A' of 
cardinality less than (1 + -) n ( Il3] ). A 7-net K is a set of 
points such that ||i> ||a = 1 for all v k in K and for any z with 
||z|| 2 = 1, there exists some v such that \\z — v k \\ 2 < 7. 

Since A has i.i.d N(0, 1) entries, then Av k has to i.i.d. 
iV(0, 1) entries. Applying a union bound to Corollary [T] and 
12 we know that for some 6 > and for every e > 0, with 
probability 1 — 2e~ cm for some c > 0, we have 

S P (Av k ) < (1 - £)S (12) 



(l-e)S<Si(Av fc ) < (l + e)S 



(13) 



hold for a vector w fc in K. Taking to = 0471 for large enough 
C4, from union bound we get that ( TTZb and ( fT3l ) hold for all the 
points in K at the same time with probability at least 1 — e _C5 ™ 
for some C5 > 0. 

For any z such that ||z|| 2 = 1, there exists vq in K such that 
|| jsr — U0II2 — 7i < 7- Let Z! denote z — z; , then ||zi — 71U1II2 = 
72 < 7i7 < 7 2 for some «i in K. Repeating this process, we 
have 

z = E^' 

where 70 = 1, 7^ < 7 J and Vj € K. 

Thus for any z € R™, we have z — \z\i Ej>o "fj v j- 
For any index set T with \T\ < pm, 



iGT 



i£T j>0 
i£T j>0 

= ikii?E^ p Ei(^)ii p 

11 II2 2(1- 7 p) 



ikii!El(E7i^)ii p 



i j>0 

> \\z\\ P Y,(Uv ). 



> ||z||^(El(^o) l | P 



> \\4m~t)s- 



3>1 



E7 w Ei(^)^ p ) 

j>i % 

7 JP (1 + e)S) 



1 - jp 

Thus E Uz)r\ p - E > S||z|| p ^2^. For 

a given 5, we can pick 7 and e small enough such that 

E \( A z)i\ p ~ E {(AzW > tis\\4i " ■ 

We can now establish one main result regarding the thresh- 
old of successful recovery with Z p -minimization. 

Theorem 2. For any < p < 1, given any p < p*(p), there 
exist constants C4, C5 > smc/z fnaf w/ien to > 0471 and n is 
large enough, with probability 1 — e~ C5 ™, an to x n matrix 
A with i.i.d. N(0, 1) entries has the following property: for 
every f G R" ana" every error e w/?n ifs support T satisfying 
\T\ < pTO, / /s f/ze unique solution to the l p -minimization 
problem (0. 

Proof: Lemma [3] indicates that EieT c — 
EieT l(^- z )i| P — ^S||z||2 > for every non-zero z, then from 



Theorem [U / is the unique solution to the Z p -minimization 
problem ©. ■ 
We remark here that p* is a sharp bound for successful 
recovery. For any p > p* , from Lemma [2] with overwhelming 
probability the sum of the largest \pm] terms of |(ylz)i| 3 "s 
is more than the half of the total sum Si, then Theorem Q] 
indicates that the l p -recovery fails in this case. In fact, for 
any vector /' 7^ /, let z = f — /, and let T be the support 
of the largest \pm~] terms of |(Az)i| p 's. If the error vector e 
agrees with on the support T and is zero elsewhere, 

then with large probability \\e— Az\\ p is no greater than that 
of \\e\\P, which implies that / p -minimization cannot correctly 
return /. Proposition Q] thus implies that the threshold strictly 
decreases as p increases. The performance of l pi -minimization 
is better than l p2 -minimization for pi < p 2 < 1 in the sense 
that the sparsity requirement for the arbitrary error vector is 
less strict for smaller p. 

III. Recovery From Error Vector With Fixed 
Support and Signs 

In Section [II] for some p > 0, we call Z p -minimization 
successful if and only if it can recover / from any error e 
whose support size is at most pm. Here we only require l p - 
minimization to recover / from errors with fixed but unknown 
support and signs. We will provide a sharp threshold p* w 
of the proportion of errors below which ^-minimization is 
successful. 

Once the support and the signs of an error vector is fixed, 
the condition of successful recovery with /i-minimization from 
any such error vector is the same, however, the condition of 
successful recovery with l p -minimization from different error 
vectors differs even the support and the signs of the error 
is fixed. Here we consider the worst case scenario in the 
sense that the recovery with Z p -minimization is defined to be 
"successful" if / can be recovered from any such error e. 
We characterize this case in Theorem [3] Note that if there 
is further constraint on e, then the condition of successful 
recovery with Z p -minimization may be different from the one 
stated in Theorem [3] 

Theorem 3. Given any p £ (0,1), for every f G R" and 
every error e with fixed support T and fixed sign for each entry 
Bi, i G T, if f is always the unique solution to l p -minimization 
problem (fJJ, then 

E i(^)*r< E k^)*i p 

iET- ieT" 

for all z G R" where T~ = {i £ T : {Az)^ < 0}. 

Conversely, f is always the unique solution to lp- 
minimization problem (0 provided that 



ieT- 



\(Az)i\*< V \(Az)i\ p 



ieT" 



for all non-zero z G R™. 



Proof: First part. Suppose there exists z such 

*at \( Az )i\ P > Ei e Td(^l P . let s = 

Ei & T-\(^)i\ P -EieTo\(Az)^>0. 



Let &i = for every i in T c , let ei — — (Az)i for every i in 
T~. For every i in T+ := T — T~, let e. t satisfy (Az)^ > 0. 
As p £ (0, 1), we can pick ei (i £ T + ) with |e<| large enough 



such that 



(Az) 



£ ieT+ < |. Then 



M\ P P = E °+ E ki + OW+E \{Az)i 

iET- ieT+ ieT" 

E n p + | + Ek^)*i p 



< 



i£T+ 



ieT" 



E n p + o + E 



ieT+ 



i£T- 



Thus ||y - A(f - z )\\P = \\e + Az\\ p P <\H p P = \\v- 4fll£, f 
is not a solution to which is a contradiction. 

Second part. For any e on support T with fixed signs and 
for any /, let y = Af + e. For any x ^ /, let z = f — x, and 
so 

\\y-Ax\\l = \\{y-Af)+Az\\l 

= e k + ( Az h\ p + E i e * + ( Az ) AP + E i^w 



> 



> 



E 

\\e\\ p - 



ieT" 



E 

ieT- 



l(^)il p ) 



ieT' 



Uz) t \ p 



The first inequality holds as for each i in T + , (Az)i has the 
same sign as that of if not zero; and for p £ (0,1), \ei + 
(Az)i\ p > \ei\ p — \(Az)i\ p holds. The second inequality comes 
from the assumption that \( Az )i\ p < E \(Az)i\ p . Thus 

|^-AT||P>||y-A/||Pfof T all^/. ^ ■ 

Lemma 4. Let X\, X2,.~,X m be i.i.d. N(0, 1) random vari- 
ables and T be a set of indices with size \T\ = pm for some 
p > 0. Let e £ R m be any vector on support T with fixed 
signs for each entry. If ' p < p* w = |, for every e > 0, when m 
is large enough, with probability 1 — e~ Cem for some constant 
C6 > 0, the following two properties hold: 

• \pm{p - e) < E ie T:X !ei <o l X 'l P < \P mi yV + e ) 
. (1 - p)m(p - e) < J2ieT<= \ X *\ P < i 1 ~ P)m{n + e). 
where p = E[\X\ P ], X - N(0, 1). 

Proof: Define a random variable Sj for each z in T that 
is equal to 1 if X^i < and equal to otherwise. Then 

EieT:X i e i<0 \ X i\ P = E^tI^I^- ^[W*] = ^ for 

every i in T as Xj ~ X(0, 1). From Chernoff bound, for 
any e > 0, there exist d\ > and d-i > such that 

^MEier < ipm(M ~ e)} < e- d i"\ 

PriEieT \ x i\ p si > \pm(ji + e)] < e"*"*. 

Again from Chernoff bound, there exist some constants d% > 

0, d& > such that 

^Ei 6 T« l^l P ^ (! - /°) m (^ ~ £ )1 ^ e"*™' 
^[E ieT = l^l P > (! - P) m (^ + e)] < e~ d4m . 



By union bound, there exists some constant cq > such that 
the two properties stated in the lemma hold with probability 
at least 1 - e - Cem . 

■ 

Lemma H implies that X)ieT:X iei <o \ X *\ P < X«eT- \ X i\ P 
holds with large probability when \T\ — pm < |m. Applying 
the similar net argument in Section [II] we can extend the result 
to every vector Az where matrix A mxn has i.i.d. Gaussian 
entries and z is any vector in R" . Then we can establish the 
main result regarding the threshold of successful recovery with 
Zp-minimization from errors with fixed support and signs. 

Theorem 4. For any p € (0, 1), given any p < |, there 
exist constants c-j, c% > such that when m > cjn and n is 
large enough, with probability 1 — e~ c%n , an m x n matrix 
A with i.i.d. N(0, 1) entries has the following property: for 
every f G R" and every error e with fixed support T satisfying 
\T\ < pm and fixed signs on T, f is the unique solution to 
the l p -minimization problem (0. 

Proof: From lemma [H applying similar arguments in the 
proof of lemma |2 we get that when m > cjn and n is large 
enough, with probability 1 — e _Csn for some c$ > 0, 

• kprn{n - e) < Y. i£ t-(Av)^<o \i Av )i\ P < iP m (n + e ) 
. (1 - p)m{p - e) < £ 4eT c \(Av) t \P < (1 - p)m(ji + e) 

hold for all the vectors v in a 7-net K at the same time. 

Moreover, for any z £ R™, we have z — \\z\\2 Sj>o "fj v j> 

where 70 = 1, Vj € K for all j and 7j < 7 J . 

Let T- = {ieT : (Az)^ < 0}. For any i in T - , 



Thus E ie T.|(^)i| P -Ei 6 T-l(^) 



> u 



ip_m/j_ 



1 



|(Az) 



< 



< 



NII2K XI 

j:(Ati 3 ) ie ,<0 

MIS E 

j:(A« i ) i e < <0 



7 JP l(^)i| P 



where the first inequality holds as {Az)iCi < 0. Then 



E 

ier- 



\(Az)i\* < \\z\\ p 2 J2 



< 



E -t'UvM* 

i£T- j:(ADj)iei<0 



Jp 



E 



l(^)i| p 



< 



J>0 ieT:(Avj)iei<0 
1 



U|| p 

ll2 2(l-7P) 



pm(p + e) 



Ei(^w p = W2Ei(E^M p 

> iki(Ei(^)^-E^Ei( Aw M p ) 

iST c j>l ieT" 

> \\z\\ p 2 ((l - p)m(M - e) - E 7 3P (1 - p)m(/i + e)) 
/i - 2^i 7 P - e 



ji£T~ IV^JiV ^ 11^112 1 — fP' 

|p — 27 p (l — p) — -(1 — |)). For any p < |, we can pick 
7 and e small enough such that the righthand side is positive. 
The result follows by applying Theorem [3] 



We remark here that is a sharp bound for successful 
recovery in this setup. For any p > p* w , from Lemma @] 



with overwhelming probability that ^ 



i€T:Xiei<0 



w > 



J2ieT c l^«l P ' then Theorem [3] indicates that the Z p -recovery 
fails for some error vector e in this case. 

Surprisingly, the successful recovery threshold p* when 
fixing the support and the signs of an error vector is | for 
all p in (0, 1) and is strictly less than the threshold for p = 1, 
which is 1 (IT4|). Thus in this case, Zi-minimization has better 
recovery performance than that of Z p -minimization (p < 1) in 
terms of the sparsity requirement for the error vector. The 
result seems counterintuitive, however, it largely depends on 
the definition of successful recovery in terms of worse case 
performance. The condition of successful recovery via h- 
minimization from any error vector on the fixed support with 
fixed signs is the same, while the condition of Z p -minimization 
from different error vectors differs. 
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